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Abstract 

A resonance search has been made in the D*^p^ invariant-mass spectrum with 
the ZEUS detector at HERA using an integrated luminosity of 126 pb~^. The de- 
cay channels D*+ L)°7r+ ^ {K--K+)Tit and D*+ D°7r+ ^ {K' ti+ ti+ ti-)ti+ 
(and the corresponding antiparticle decays) were used to identify D*"^ mesons. 
No resonance structure was observed in the D*^'p^ mass spectrum from more 
than 60 000 reconstructed Z)*^ mesons. The results are not compatible with a 
report of the HI Collaboration of a charmed pentaquark, B[?. 
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1 Introduction 



The observation of a narrow strange baryonic state decaying to K^n or K^p has been 
reported by several experiments [1]. This state has both baryon number and strangeness 
of +1. Thus the resonance cannot be composed of three quarks but could be explained as 
a bound state of five quarks: 0"^ = uudds. Evidence for two other pentaquark states with 
strangeness of —2 has also been reported recently [2]. Although no strange pentaquark 
production has been observed in some searches [3], the existence of 9"*" is supported by 
recent results obtained in ep collisions at HERA [4]. Several QCD models are able to 
explain the nature of the strange pentaquarks [5-7]. 

The expected properties of charmed pentaquark states have been discussed in the liter- 
ature [6,8-10]. The lightest charmed pentaquark would be 6° = uuddc. In predictions 
based on the diquark-diquark-antiquark model of Jaffe and Wilzcek [6], the mass of 0° 
is typically below the sum of the masses of the D~ meson and proton. In this case, 0° 
should decay weakly to, e.g., 0+71". Predictions utilising the diquark-triquark model of 
Karliner and Lipkin [9] suggest a heavier 0° decaying dominantly to D~p. If the mass of 
the 0° were sufficiently large, it could also decay to D*~p] there is a possibility that this 
decay mode is dominant [11]. 

The observation of a narrow charmed baryonic resonance decaying to D*^p^ has recently 
been reported by the HI Collaboration [12]. A peak containing 50.6 ± 11.2 events was 
observed in deep inelastic scattering (DIS) with exchanged photon virtuality > 1 GeV^ 
at a mass of 3099±3(stat.)±5(syst.) MeV and with a Gaussian width of 12±3(stat.) MeV, 
compatible with the experimental resolution. A signal with compatible mass and width 
was also observed in photoproduction (Q^ < IGeV^). The observed resonance was 
claimed to contribute roughly 1% to the total D*^ production rate in the kinematic 
region studied. 

This paper presents results of a search for narrow states in the D*^p^ decay channel in 
e^p collisions at HERA using the ZEUS detector. 

2 Experimental set-up 

The analysis was performed with the data taken by the ZEUS Collaboration from 1995 to 
2000. In this period, HERA collided electrons or positrons^ with energy E^. = 27.5 GeV 
and protons with energy Ep = 820 GeV (1995-1997) or Ep = 920 GeV (1998-2000). The 
data used in this analysis correspond to an integrated luminosity of 126.5 ± 2.4 pb~^. 

^ From now on, the word "electron" is used as a generic term for electrons and positrons. 
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A detailed description of the ZEUS detector can be found elsewhere [13]. A brief outline 
of the components most relevant to this analysis is given below. 

Charged particles are tracked in the central tracking detector (CTD) [14], which operates 
in a magnetic field of 1.43 T provided by a thin superconducting solenoid. The CTD 
consists of 72 cylindrical drift chamber layers, organized in nine superlayers covering the 
polar-angle^ region 15° < 6* < 164°. The transverse-momentum resolution for full-length 
tracks is a{pT)/VT = 0.0058pr © 0.0065 © 0.0014/pr, with pr in GeV. To estimate the 
energy loss per unit length, dE/dx, of particles in the CTD [15], the truncated mean 
of the anode-wire pulse heights was calculated, which removes the lowest 10% and at 
least the highest 30% depending on the number of saturated hits. The measured dE/dx 
values were corrected by normalising to the dE/dx peak position for tracks around the 
region of minimum ionisation for pions, 0.3 < p < 0.4 GeV. Henceforth dE/dx is quoted 
in units of minimum ionising particles (mips). The resolution of the dE/dx measurement 
for full-length tracks is about 9%. 

The high-resolution uranium-scintillator calorimeter (CAL) [16] consists of three parts: 
the forward (FCAL), the barrel (BCAL) and the rear (RCAL) calorimeters. Each part 
is subdivided transversely into towers and longitudinally into one electromagnetic sec- 
tion (EMC) and either one (in RCAL) or two (in BCAL and FCAL) hadronic sections 
(HAC). The smallest subdivision of the calorimeter is called a cell. The CAL energy res- 
olutions, as measured under test-beam conditions, are a{E)/E = O.IS/V^ for electrons 
and a(E)/E = 0.35 /\^ for hadrons, with E in GeV. The position of electrons scattered 
with a small angle with respect to the electron beam direction was measured using the 
small-angle rear tracking detector (SRTD) [17]. 

The luminosity was determined from the rate of the bremsstrahlung process ep — e'yp, 
where the photon was measured with a lead-scintillator calorimeter [18] located at Z = 
-107 m. 



3 Event simulation 

Monte Carlo (MC) samples of charm and beauty events were produced with the Pythia 
6.156 [19] and Rapgap 2.0818 [20] event generators. The generation included direct pho- 
ton processes, in which the photon couples directly to a parton in the proton, and resolved 
photon processes, where the photon acts as a source of partons, one of which participates 

^ The ZEUS coordinate system is a right-handed Cartesian system, with the Z axis pointing in the 
proton beam direction, referred to as the "forward direction" , and the X axis pointing left towards 
the centre of HERA. The coordinate origin is at the nominal interaction point. 
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in the hard scattering process. The CTEQ5L [21] and GRV LO [22] parameterisations 
were used for the proton and photon structure functions, respectively. The Lund string 
model [23] as implemented in Jetset [19] was used for hadronisation. The Bowler mod- 
ification [24] of the LUND symmetric fragmentation function [25] was used for the charm 
and bottom quark fragmentation. The charm and bottom quark masses were set to the 
values 1.5 GeV and 4.75 GeV, respectively. All processes were generated in proportion to 
the predicted MC cross sections. The combined sample of the Pythia events, generated 
with < 0.6 GeV^, and the Rapgap events, generated with > 0.6 GeV^, was used as 
the inclusive D*^ MC sample after reweighting the D*^ transverse momentum, px^D*^), 
and pseudorapidity, ri{D*^), distributions to describe the data. 

To generate the 6°, the mass of a neutral charmed baryon in the Jetset particle table 
was set to 3.099 GeV [12], its width was set to zero and the decay channel was set to D*~p. 
The G° samples produced with the Pythia and Rapgap generators were combined in 
the same way as described in the previous paragraph. Since the production mechanism 
of the G° is unknown, the simulated Pr(0c) and rjiQ^) distributions were reweighted to 
the pt{D*^) and ri[D*^) distributions of the inclusive D*^ MC which describes the data. 

The generated events were passed through a full simulation of the detector using Geant 
3.13 [26] and processed with the same reconstruction program as used for the data. 



4 Event selection and reconstruction of D mesons 

The D*^{2010) mesons were identified using the two decay channels 

D*+ ^ D^nt - (A'-7r+)7r+ (1) 

D*+ L)°7r+ ^ (A'"7r+7r+7r")7r+. (2) 

Charge-conjugate processes are included. The vr^ particle from the D*^ decay is referred 
to as the "soft pion" because it is constrained to have limited momentum by the small 
mass difference between the D*~^ and D^. 

Events from both photoproduction [27] and DIS [28] were selected online with a three-level 
trigger [13,29]. At the third level, where the full event information was available, the nom- 
inal D* trigger branch required the presence of a reconstructed D*-meson candidate and, 
for DIS, a scattered-electron candidate. The efficiency of the online D* reconstruction, 
determined relative to the efficiency of the offline D* reconstruction using an inclusive DIS 
trigger and a photoproduction dijet trigger, was above 95% for most of the data-taking 
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period. Events missed by the nominal D* trigger but selected with some other trigger 
branch were also used in this analysis. 

In the offline analysis, only events with | .^vertex | < 50 cm, where ^'vertex is the primary 
vertex position determined from the CTD tracks, were used. For each event, a search for 
the scattered electron from the pattern of energy deposits in the CAL [30] was performed. 
If a scattered-electron candidate was found, the following criteria were imposed to select 
DIS events: 

• the scattered electron energy above 8 GeV; 

• the impact point of the scattered electron on the RCAL outside the (X, Y) region 
(24cm, 12cm) centered on the beamline; 

• 40 < E — Pz < 65 GeV, where E — Pz = T.i{E — Pz)i and the sum runs over a 
combination of charged tracks, as measured in the CTD, and energy clusters measured 
in the CAL [31]; 

• y < 0.95, where y is the fraction of the electron energy transferred to the proton in its 
rest frame. For this cut, y was calculated from the energy and angle of the scattered 
electron; 

• > 1 GeV^, using measurements of the energy and angle of the scattered electron. 

All events which failed the DIS selection were assigned to the photoproduction sample. 

Monte Carlo studies showed that 98% of the DIS sample consisted of events with true 
> 1 GeV^ and 95% of the photoproduction sample consisted of events with true 
< 1 GeV^. The migrations were taken into account in the correction procedure for 

detector effects (Section 7). 

In each event, charged tracks measured by the CTD and assigned to the primary event 
vertex were selected. The transverse momentum was required to be greater than 0.1 GeV. 
Each track was required to reach at least the third super layer of the CTD. These restric- 
tions ensured both good track acceptance and good momentum resolution. 

Selected tracks were combined to form candidates assuming the decay channels (1) or 
(2). For both cases, candidates were formed by calculating the invariant mass M{K'k) 
or M^K-KTiTx) for combinations having a total charge of zero. The soft pion was required 
to have a charge opposite to that of the particle taken as a kaon and was used to form a 
D* candidate having mass M^KtttTs) or MlKmririrs). No particle identification was used, 
so kaon and pion masses were assigned in turn to each track. 

To reduce the combinatorial background, the following transverse momentum require- 
ments were applied to tracks from the above combinations: 

Pt{K) > 0.45 GeV, priTr) > 0.45 GeV, pTiiTs) > 0.1 GeV 
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for channel (1), and 

PriK) > 0.5 GeV, pr(vr) > 0.2 GeV, priTis) > 0.15 GeV 

for channel (2). The D* candidates were required to have —1.6 < ri{D*) < 1.6, where the 
CTD acceptance is high. Also, priD*) > 1.35 GeV or Pt{D*) > 2.8 GeV for channels (1) 
or (2), respectively, was required to further reduce the combinatorial background. 

For selected D* candidates, consistency of the M{Kt\:) or M{KTT7nr) value with the nom- 
inal mass was required. To take account of the mass resolution, the requirement 

was 

1.83 < M{K7i) < 1.90 GeV, 1.845 < M{K7nnT) < 1.885 GeV 
for Pt{D*) < 5 GeV, 

1.82 < M{K7i) < 1.91 GeV, 1.835 < M^Kmrn) < 1.895 GeV 
for 5 < Pt{D*) < 8 GeV, and 

1.81 < M{Kn) < 1.92 GeV, 1.825 < M^Kmni) < 1.905 GeV 
for Pt{D*) > 8 GeV. 

To suppress the combinatorial background, a cut on the ratio pt{D*) / E^^^ was applied, 
where E^-^^^ is the transverse energy measured in the GAL outside a cone of ^ = 10° 
around the forward direction. For DIS events, the energy assigned to the scattered electron 
was excluded from the EI^^^ calculation. The cut value was pt{D*)/E^^^ > 0.12 and 
Pt{D*) / Elp'^^ > 0.2 for channels (1) and (2), respectively. Monte Carlo studies showed 
that this cut removed a significant fraction of the background whilst preserving most of 
the D* mesons produced either inclusively or in 0° decays. 

The mass difference AM = M{K7r7rs) - M{K-k) for channel (1) or AM = M^Kn-rnnXs) - 
M{K7nr7r) for channel (2) was evaluated for all remaining D* candidates. Figures ^ 
and^ show the mass-difference distributions for channels (1) and (2), respectively. In 
Figs. CJ: and the mass- difference distributions are shown for DIS events with > 
1 GeV^. Peaks at the nominal value of M(D*+) — M{D^) are evident. For channel (2), the 
same tracks can produce two candidates due to an ambiguity in the kaon and pion mass 
assignment to tracks with the same charge. Such candidates produce different M(i^ vrvrvr) 
values and almost identical AM values. To exclude double counting, both combinations 
of the same tracks which passed all cuts, including the M^Kinni) requirement, were 
included with a weight 1/2. 

To determine the background under the peak, wrong-charge combinations were used. For 
both channels (1) and (2), these are defined as combinations with total charge ±2 for the 
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D° candidate and total charge ±1 for the D* candidate. The histograms in Fig. ^ show 
the AM distributions for the wrong-charge combinations, normahsed to the distributions 
of D* candidates with the appropriate charges in the range 0.15 < AAf < O.lTGeV 
for channel (1) and 0.15 < AAf < 0.16 GeV for channel (2). The upper ends of the 
normalisation ranges correspond to the trigger selections of D* candidates in the two 
decay channels. For both channels, the same tracks from a wrong-charge combination can 
produce two candidates due to an ambiguity in the kaon and pion mass assignment to 
tracks with the same charge. For channel (2), it is also possible to have three wrong-charge 
candidates produced by the same tracks. To exclude double and triple counting, the 
multiple combinations of the same tracks which passed all cuts, including the M{Ktt) or 
M[Ktxt^'k) requirement, were included with a weight 1/2 or 1/3 for double or triple entries, 
respectively. Monte Carlo studies showed that the procedure used for the background 
determination and the treatment of multiple entries permits the recovery of the number 
of true D* mesons for both channels (1) and (2). 

To improve the signal-to-background ratio, only D* candidates with 0.144 < AAf < 
0.147 GeV for channel (1) and 0.1445 < AM < 0.1465 GeV for channel (2) were kept for 
the charmed pentaquark search. After background subtraction, signals of 42680 ± 350 
D*"^ mesons in channel (1) and 19900 ± 250 D* mesons in channel (2) were found in the 
above AM ranges. In DIS with > 1 GeV^, the numbers of reconstructed D* mesons 
were 8680 ± 130 in channel (1) and 4830 ± 120 in channel (2), whereas for < i QeV^ 
34000 ±330 and 15070 ±220 D* mesons were found in channels (1) and (2), respectively. 

The relative acceptance for D* mesons originating from the 0° and D* mesons produced 
inclusively, A®°(D*)/v4'°'=(D*), was calculated using the e° and the inclusive D* MC 
samples. The values of this relative acceptance were 85% and 87% for the samples with 
D* reconstructed in the decay channels (1) and (2), respectively. 

5 Selection of proton candidates and D*p invariant 
mass reconstruction 

A charmed pentaquark candidate was formed by combining a selected D* candidate with 
a track, assumed to be a proton, with px > 0.15 GeV and a charge opposite to that of the 
D*. For each charmed pentaquark candidate, the "extended" mass difference, AM'^^* = 
M{Ktx'Ks'p) - MiKnTTs) or AM^^* = MlK-KTrn-KsP) - M^KTmrnis), was calculated. The 
invariant mass of the D*p system was calculated as M{D*p) = A]VP^^ ± M{D*~^)p-[)Q, 
where M(D*+)pdg is the nominal D*^ mass [32]. The resolution in M{D*p) for M{D*p) ~ 
3.1 GeV, where a narrow signal was reported by the HI Collaboration [12], was estimated 
from MC simulations to be 4 MeV. 
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To reduce pion and kaon backgrounds, the measured dE/dx values for proton candidates 
were used. To ensure good dE/dx resolution, at least eight CTD hits were used. Figure |21 
shows the dE/dx values as a function of momentum, P, for particles which yield a mass 
M{D*p) < 3.6 GeV. The proton bands are clearly seen in the distributions for particles 
associated with D* in both decay channels. The parameterisation for the expectation 
value of dE/dx as a function of P/m was obtained using tagged protons from A° decays 
and tagged pions from decays. To construct a Xi function, the following procedure [33] 
was used. For each particle, a xl value that estimates the deviation of the measured dE/dx 
from the expectation was calculated as: 

2 _ [ln{dE/dx) - \n{dE/dx)e^pectedV 

Xl- 2 

^\n{dE/dx) 

The resolution was parameterised empirically as cy\.a{dE/dx) = a/ a/?^, where n is the number 
of hits used for the dE/dx measurement and a is a constant determined from the sample of 
tagged protons. The Xi probability of the proton hypothesis, /p, is given by the probability 
for a proton to produce the observed or a larger value of Xi- 

The distribution of Ip for proton candidates shows a sharp peak at /p ~ and becomes 
relatively flat towards /p ~ 1. To maximise the ratio of the number of selected protons to 
the square root of the number of background particles, a cut Ip > 0.15 was applied. 

The acceptance of the proton selection before the requirement on Ip, A{p), was calculated 
using the MC to be 85% and 89% for the samples with D* reconstructed in the decay 
channels (1) and (2), respectively. The acceptance A{lp > 0.15) was calculated, using the 
tagged protons, to be (85.0 ± 0.1)%. This acceptance, calculated directly from the data, 
was insensitive to the proton momenta spectrum. 



6 D*p invariant mass distributions 

Figure Eti' shows the M{D*p) distribution^ for D* meson candidates reconstructed in the 
decay channel (1). No narrow resonance is seen. To suppress the large background from 
pion and kaon tracks, the following two selections were used in addition to the general 
proton selection described in Section 5: 

• low-momentum selection: only tracks with P < 1.35 GeV and dE/dx > 1.3 mips were 
used as proton candidates. These requirements select clean proton samples corre- 
sponding to the proton bands separated from the pion and kaon bands in Fig. |21 

^ The M{D*p) distributions, shown in this paper for M{D*p) < 3.6 GeV, were investigated in the full 
kinematically allowed range. 
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• high-momentum selection: only tracks with P > 2 GeV were used as proton candi- 
dates. This selection was suggested by the observation of the HI Collaboration [12] 
that the signal-to-background ratio for charmed pentaquarks improves as the proton 
momentum increases. 

Figures Ob and |2t show the M[D*p) distributions for the low-momentum and high- 
momentum proton selections, respectively. The selections reveal no narrow resonance. 

Figure shows the M{D*p) distribution, obtained with D* meson candidates recon- 
structed in the decay channel (1), for DIS with > 1 GeV^. Figures Eb and EJ; show 
the M{D*p) distributions for the low-momentum and high-momentum proton selections, 
respectively. No narrow resonance is seen in either distribution. 

Figure El shows the M{D*p) distributions, obtained with D* meson candidates recon- 
structed in the decay channel (2), for the full data sample (Fig. and for DIS with 
> 1 GeV^ (Fig. Eb)- Both distributions show no narrow resonance. No resonance was 
also observed using the low- momentum and high- momentum proton selections with D* 
meson candidates reconstructed in the decay channel (2) (not shown). 

The histograms in Figs. OMSl show the M{D*p) distributions for like-sign combinations of 
D*^ and proton candidates. The shapes of the mass distributions for the unlike-sign and 
like-sign combinations are similar. The like-sign distributions lie below the unlike-sign 
distributions at low M{D*p) values, which is consistent with MC predictions. 

6.1 Systematic checks 

The selection cuts were varied to check that the pentaquark signal was not lost due to some 
specific selection requirement or hidden by the combinatorial background. In particular, 
the following systematic checks were carried out: 

• variations were made in the cuts on Ip and on the number of CTD hits used for the 
dE/dx measurement; 

• the cut on Ip was replaced by a requirement for proton candidate tracks to lie within 
a wide dE / dx band [4] ; 

• the high-momentum proton selection was repeated without cuts on Ip or on the number 
of CTD hits used for the dE/dx measurement; 

• to reduce the pion background in the proton candidate sample, reflections from the 
decays of the excited D mesons, 0^,02^-^0*^71^, to the M(Z)*^p^) spectra were 
removed by excluding all combinations with 2.38 < M{D*^7r^) < 2.5 GeV; 

• DIS events were selected with > 20 GeV^, i.e. in the range where the cleanest 
0"*" signal was observed in the previous ZEUS analysis [4]. Using this selection, the 
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numbers of reconstructed D* mesons were 2326 ± 67 in channel (1) and 1799 ± 78 in 
channel (2); 

• DIS events were selected using only the inclusive DIS trigger. Using this selection, the 
numbers of reconstructed D* mesons were 3426 ± 82 in channel (1) and 2369 ± 86 in 
channel (2); 

• tracks not assigned to the primary event vertex were used together with the primary 
vertex tracks for D* reconstruction and proton candidate selection. 

No signal was observed using any of these selection variations. 

The analysis was also repeated for the D* decay channel (1) using very similar selec- 
tion criteria used in the analysis of the HI collaboration [12]. The minimum transverse 
momentum requirements applied to tracks forming D* combinations were set to the HI 
values. The cut pt{D*)/E^>^^ > 0.12 used in the ZEUS analysis was replaced by the cut 
z{D*) > 0.2, where z{D*) = P ■ p{D*)/P ■ q and P, p{D*) and q are the four-momenta 
of the incoming proton, the D* meson and the exchanged photon. In the proton rest 
frame, z{D*) is the fraction of the photon energy carried by the D*^ meson. The re- 
quirements on M{Ktt) and AM were kept as in the nominal ZEUS analysis since they 
were determined by the mass resolution of the ZEUS CTD.^ The DIS events were se- 
lected with > 1 GeV^ and 0.05 < y < 0.7, while the photoproduction events were 
selected with < 1 GeV^ and 0.2 < y < 0.8. The D* candidates were required to have 
-1.5 < ri{D*) < 1.0 and priD*) > 1.5 GeV or pt{D*) > 2.0 GeV in DIS or photopro- 
duction selections, respectively. The numbers of reconstructed D* mesons found using 
these cuts were 5920 ± 90 and 11670 ± 140 for the DIS and photoproduction selections, 
respectively. To select proton candidates, the requirement Ip > 0.15 was replaced by 
the HI requirements on the normalised proton likelihood [12]. The range of the proton 
momentum 1.6 — 2.0 GeV was excluded in the case of photoproduction. 

Figure IHl shows the M{D*p) distributions separately for the DIS and photoproduction 
events selected using the HI criteria. There is no indication of a narrow resonance in 
either distribution. Yields of combinations in the ZEUS and HI M{D*p) distributions 
for DIS are in approximate proportion to the corresponding numbers of D* mesons. The 
histograms in Fig. IHl show a two-component model in which the wrong charge {K7r)7rs 
combinations, normalised as described in Section 4, were used to describe the non-charm 
contribution, and the inclusive D* MC simulation, normalised to the D* yield in the data, 
described the contribution of real D* mesons. The model describes the measured M{D*p) 
distributions well. 



^ The check was also repeated with the HI requirements on M{Ktt) and AM. 



9 



7 Evaluation of upper limits 



Upper limits on the fraction of D* mesons originating from the G° decays were set in 
the signal window 3.07 < M{D*p) < 3.13 GeV. This window covers the HI measurement 
taking into account the uncertainties of the measured 0° mass and width. The upper 
limits were calculated for the full D*-meson samples obtained with D* reconstructed in 
channels (1) and (2), see Figs. [7^ and[7|D. The calculations were also separately repeated 
with the samples obtained in DIS (see Figs. Eh and[Z|i) and photoproduction (not shown). 
Each M{D*p) distribution was fitted outside the signal window to the functional form 
exp{—bx + cx^), where x = AM^^^ — rup and rrip is the proton mass. The fitted curves 
describe the M{D*p) distributions reasonably well in the whole range shown in Fig. [7| 
The number of reconstructed 0^ baryons was estimated by subtracting the background 
function, integrated over the signal window, from the observed number of candidates 
in the window. This number was divided by the number of reconstructed D* mesons, 
yielding the fraction of D* mesons originating from the 0° decays, R{Q^ — > D*p/D*). 

The numbers used for the upper-limit calculations and the measured upper limits are 
summarised in Table 1. The reported upper limits are the frequentist confidence bounds 
calculated assuming a Gaussian probability function in the unified approach [34]. The 
results are shown separately for the full data sample, for DIS with > 1 GeV^ and for 
photoproduction with Q'^ < 1 GeV^. 

The 95% C.L. upper limits on i?(0° D*p/D*) were found to be 0.29% and 0.33% 
for the full D*-meson samples obtained with D* reconstructed in channels (1) and (2), 
respectively. To average the R{Qc ~^ D*p/D*) values obtained with D* reconstructed in 
the two decay channels, a standard weighted least-square procedure [32] was used. The 
combined upper limit from both decay channels is 0.23%. The combined upper limit for 
DIS with g2 > 1 GeV^ is 0.35%. 

The HI Collaboration reported a 0° baryon contributing roughly 1% of the D* production 
rate, in the kinematic region studied in that analysis, in DIS with > 1 GeV^, and a clear 
signal of compatible mass and width in a photoproduction sample (Q^ < 1 GeV^) [12]. 
If the 0° baryon contributed 1% of the number of D* mesons in the kinematic region 
studied in this analysis, a signal of 626 0° baryons would be expected using the full 
samples of the D* mesons reconstructed in both decay channels. Assuming Gaussian 
statistics, such a signal together with the expected number of background events could 
produce the observed number of events in the signal window only in cases of statistical 
fluctuations larger than 9 cr. A production rate corresponding to 1% of D*^s of the present 
analysis in the DIS (Q^ > 1 GeV^) sample only is excluded at 5cr. In Fig. [71 the MC 0° 
signals normalised to 1% of the numbers of reconstructed D* mesons are shown on top of 
the fitted backgrounds. 
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To correct the fraction of D* mesons originating from the 6° decays for detector effects, 
the relative acceptance was calculated from the acceptances defined in Sections 4 and 5 
as: 

= )^ ■ A{p) ■ A{lp > 0.15 . 

The systematic uncertainty of the background fit procedure was estimated by varying 
the range used in the fit. To estimate the systematic uncertainty in the MC correction 
factors, the Pt(6c) and 77(6°) spectra of the 6° MC were varied. Both systematic uncer- 
tainties and the statistical uncertainties of the data, MC and A{lp > 0.15) were added in 
quadrature to determine the total uncertainty used for the upper-limit calculation. The 
95% C.L. upper limits on the corrected fraction of D* mesons originating from 6^ decays, 
^corj^QO _^ D*p/D*), were found to be 0.47% and 0.50% for the full L)*-meson samples 
obtained with D* reconstructed in channels (1) and (2), respectively. The combined upper 
limit from both decay channels is 0.37%. The effect of correlated systematic uncertainties 
was negligible in the combined upper limit calculation. 

The product of the fraction of c quarks hadronising as a B° baryon, /(c B[!), and the 
branching ratio of the 6° decay to D*p, B^o^j^^p, can be calculated as: 

f(r^9>'^ B _N{Ql^D*pl 

where /(c — ^ D*^) is the known rate of c quarks hadronising as D*^ mesons [35] and the 
ratio of the numbers of the 9^ and D* hadrons, ^''^"(^f] ^\ is calculated in the full phase 
space. An extrapolation of the fractions measured in the restricted pt{D*) and ri{D*) 
kinematic ranges to the full phase space would require precise modelling of the Pt(0c) 
and ri{Q^) spectra. Such modelling is currently not available. To estimate the upper 
limit on /(c 0°) ■ Bqo^£,*p, the corrected fractions of D* mesons originating from the 
0° decays were converted to the ratios of numbers of the 6° and D* hadrons in their 
respective kinematic ranges used for the D* meson selection: 



conv 



7V(eg ^ D*p;pTm > 1.35,2.8GeV; |r/(eg)| < 1.6) _ , 

N{D*;pt{D*)> 1.35,2.8 GeV;\7]{D*)\<l.Q) ^ P/ )J 

^ iV(9g ^ D*p;PT{e'c) > 1-35, 2.8 GeV; |r/(eg)| < 1.6) 
iV(0O ^ D*p;pt{D*) > 1.35, 2.8 GeV; \r]{D*)\ < 1.6)' 

The conversion factors, obtained with the 6° MC, were 1.6 and 2.8 for px > 

1.35 GeV and pr > 2.8 GeV, respectively. Using these conversion factors, the 95% C.L. 
upper limits on /(c 6°) ■ Bqo^d*p, were estimated to be 0.18% and 0.33% for the full 
D*-meson samples obtained with D* reconstructed in channels (1) and (2), respectively. 
The combined upper limit from both decay channels is 0.16%. The effect of correlated 
systematic uncertainties was negligible in the combined upper limit calculation. 
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8 Summary 



A resonance search has been made in the D*'^p^ invariant- mass spectrum with the ZEUS 
detector at HERA using an integrated luminosity of 126 pb~^. The decay channels 
£)*+ D^TT^ (A'^7r+)7r+ and D*^ D^T^t ~^ {K'ti^ii^ti')^^ (and the correspond- 
ing antiparticle decays) were used to identify D*"^ mesons. No resonance structure was 
observed in the M{D*^p^) spectrum from more than 60 000 reconstructed D*^ mesons. 
The upper limit on the fraction of D* mesons originating from decays is 0.23% (95% 
C.L.). The upper limit for DIS with > i GeV^ is 0.35% (95% C.L.). Thus, the 
ZEUS data are not compatible with the HI report of 6|? baryon production in DIS and 
photoproduction, with a rate, in DIS, of roughly 1% of the D* production rate. 



9 Acknowledgements 

We would like to thank the DESY Directorate for their strong support and encouragement. 
The remarkable achievements of the HERA machine group were vital for the successful 
completion of this work and are greatly appreciated. We thank Marek Karliner, Harry 
Lipkin and Torbjorn Sjostrand for useful discussions. 



12 



References 



[1] LEPS CoUab., T. Nakano et al., Phys. Rev. Lett. 91, 012002 (2003); 
DIANA Collab., V.V. Barmin et al., Phys. Atom. Nucl. 66, 1715 (2003); 
CLAS Collab., S. Stepanyan et al, Phys. Lett. 91, 252001 (2003); 
SAPHIR Collab., J. Barth et al., Phys. Lett. B 572, 123 (2003); 

A. E. Asratyan, A.G. Dolgolenko and M.A. Kubantsev, Phys. Atom. Nucl. 
67, 682 (2004); 

CLAS Collab., V. Kubarovsky et al., Phys. Rev. Lett. 92, 032001 (2004). 
Erratum- ibid 92, 049902 (2004); 

HERMES Collab., A. Airapetian et al., Phys. Lett. B 585, 213 (2004); 
SVD Collab., A. Aleev et al.. Preprint hep-ex/0401024, (2004). Subm. to 
Phys. Atom. Nucl; 

COSY-TOF Collab., M. Abdel-Bary et al., Phys. Lett. B 595, 127 (2004). 

[2] NA49 Collab., C. Alt et al., Phys. Rev. Lett. 92, 042003 (2004). 

[3] BES Collab., J.Z. Bai et al, Phys. Rev. D 70, 012004 (2004); 
HERA-B Collab., I. Abt et al. Preprint hep-ex/0408048, (2004). 

[4] ZEUS Collab., S. Chekanov et al, Phys. Lett. B 591, 7 (2004). 

[5] D. Diakonov, V. Petrov and M.V. Polyakov, Z. Phys. A 359, 305 (1997). 

[6] R.L. Jaffe and F. Wilczek, Phys. Rev. Lett. 91, 232003 (2003). 

[7] H. Walhser and B. Kopeliovich, J. Exp. Theor. Phys. 97, 433 (2003); 

S. Capstick, P.R. Page and and W. Roberts, Phys. Lett. B 570, 185 (2003); 
M. Karliner and H. Lipkin, Phys. Lett. B 575, 249 (2003). 

[8] C. Cignoux, B. Silvestre-Brac and J. Richard, Phys. Lett. B 193, 323 (1987); 
H. Lipkin, Phys. Lett. B 195, 484 (1987); 
D. Riska and N. Scoccola, Phys. Lett. B 299, 338 (1993); 
F. Stancu, Phys. Rev. D 58, 111501 (1998). 

[9] M. Karliner and H. Lipkin, Preprint hep-ph/0307343, 2003. 

[10] K. Cheung, Phys. Rev. D 69, 094029 (2004); 

B. Wu and B. Ma, Preprint hep-ph/0402244, (2004); 

H. Cheng, C. Chua and C. Hwang, Preprint hep-ph/0403232, (2004); 
J.J. Dudek, Preprint hep-ph/0403235, (2004). 

[11] M. Karliner. Private communication based on 

M. Karliner and H. Lipkin. Phys. Lett. B 586, 303 (2004). 

[12] HI Collab., C. Atkas et al., Phys. Lett. B 588, 17 (2004). 



13 



[13] ZEUS Collab., U. Holm (ed.), The ZEUS Detector. Status Report (unpublished), 
DESY (1993), available on http://www-zeus.desy.de/bluebook/bluebook.html. 

[14] N. Harnew et al., Nucl. Instr. and Meth. A 279, 290 (1989); 
B. Foster et al, Nucl. Phys. Proc. Suppl. B 32, 181 (1993); 
B. Foster et al, Nucl. Instr. and Meth. A 338, 254 (1994). 

[15] ZEUS Collab., J. Breitweg et al., Phys. Lett. B 481, 213 (2000); 
ZEUS Collab., J. Breitweg et al., Eur. Phys. J. C 18, 625 (2001). 

[16] M. Derrick et al, Nucl. Instr. and Meth. A 309, 77 (1991); 
A. Andresen et al., Nucl. Instr. and Meth. A 309, 101 (1991); 
A. Caldwell et al., Nucl. Instr. and Meth. A 321, 356 (1992); 
A. Bernstein et al, Nucl. Instr. and Meth. A 336, 23 (1993). 

[17] A. Bamberger et al., Nucl. Instr. and Meth. A 401, 63 (1997). 

[18] J. Andruszkow et al.. Preprint DESY-92-066, DESY, 1992; 
ZEUS Collab., M. Derrick et al, Z. Phys. C 63, 391 (1994); 
J. Andruszkow et al.. Acta Phys. Pol. B 32, 2025 (2001). 

[19] T. Sjostrand, Comp. Phys. Comm. 82, 74 (1994). 

[20] H. Jung, Comp. Phys. Comm. 86, 147 (1995). 

[21] CTEQ Collab., H.L. Lai et al., Eur. Phys. J. C 12, 375 (2000). 

[22] M. Gliick, E. Reya and A. Vogt, Phys. Rev. D 46, 1973 (1992). 

[23] B. Andersson et al., Phys. Rep. 97, 31 (1983). 

[24] M. G. Bowler, Z. Phys. C 11, 169 (1981). 

[25] B. Andersson, G. Gustafson and B. Soderberg, Z. Phys. C 20, 317 (1983). 

[26] R. Brun et al, geantS, Technical Report CERN-DD/EE/84-1, CERN, 1987. 

[27] ZEUS Collab., J. Breitweg et al., Eur. Phys. J. C 6, 67 (1999). 

[28] ZEUS Collab., J. Breitweg et al., Eur. Phys. J. C 12, 35 (2000); 

ZEUS Collab., S. Chekanov et al, Phys. Rev. D 69, 0120004 (2004). 

[29] ZEUS Collab., M. Derrick et al, Phys. Lett. B 293, 465 (1992). 

[30] H. Abramowicz, A. Caldwell and R. Sinkus, Nucl. Instr. and Meth. 
A 365, 508 (1995). 

[31] G.M. Briskin. Ph.D. Thesis, Tel Aviv University, (1998). (Unpubhshed). 

[32] Particle Data Group, K. Hagiwara et al., Phys. Rev. D 66, 10001 (2002). 

[33] O. Deppe. Ph.D. Thesis, Hamburg University, Report DESY-THESIS-2000-006, 
(1999). 



14 



[34] G.J. Feldman and R.D. Cousins, Phys. Rev. D57, 3873 (1998). 
[35] L. Gladilin, Preprint hep-ex/9912064, (1999). 



15 



D* decay 


(i^7r)7rs 


{K7T7T7l)7ls 


Both 


channel 






channels 


Full data sample 


-^window 


1710 


914 




-^backgr 


1678 ± 23 


919 ± 19 




N{D*) 


42680 ± 350 


19900 ± 250 




i?(e° ^ D*p/D*) 


< 0.29% 


< 0.33% 


< 0.23% 


^corj^QO ^ D*p/D*) 


< 0.47% 


< 0.50% 


< 0.37% 




< 0.18% 


< 0.33% 


< 0.16% 


DIS with g2 > 1 GeV^ 


-'^window 


252 


220 




-^backgr 


252.8 ±9.2 


219.8 ±8.8 




N{D*) 


8680 ± 130 


4830 ± 120 




R{Ql D*p/D*) 


< 0.41% 


< 0.69% 


< 0.35% 


^cor^QO ^ D*p/D*) 


< 0.59% 


< 1.06% 


< 0.51% 




< 0.20% 


< 0.56% 


< 0.19% 


Photoproduction with < 1 GeV^ 


-'^window 


1458 


695 




-'^backgr 


1422 ±21 


694 ± 15 




N{D*) 


34000 ± 330 


15070 ± 220 




i?(e° ^ D*p/D*) 


< 0.36% 


< 0.40% 


< 0.29% 


^cor^QO ^ D*p/D*) 


< 0.60% 


< 0.60% 


< 0.47% 




< 0.23% 


< 0.43% 


< 0.21% 



Table 1: Numbers of the M{D*p) combinations in the signal window, iV^vindow/ 
fit background estimations, iVbackgr/ numbers of reconstructed D* mesons, N{D*); 
95% CL. upper limits on the uncorrected, -R(6c — > D*p/D*), and corrected, 
^cor^QO _^ D*p/D*), fractions of D* mesons originating from 6° decays; and 
95% C.L. upper limits on the product of the fraction of c quarks hadronising as a 
0° baryon, f{c 0°), and the branching ratio of the 0° decay to D*p, i?eo^D*p- 
The results are shown for the full data sample, for DIS with > 1 GeV^ and for 
photoproduction with <1 GeV^ . 
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Figure 1: The distribution of the mass difference, AM, (dots) for (a) D*^ 
{Kti)tTs candidates in the full data sample, (h) D*^ — > (i^vrvrvr)-/?^ candidates in the 
full data sample, (c) D*^ {K'k)'Ks candidates in DIS with > 1 GeV"^ and (d) 
D*^ — > {Ktx'ktt)'Ks candidates in DIS with > 1 GeV'^. The histograms show the 
AM distributions for wrong charge combinations. Only D*^ candidates from the 
shaded bands were used for the charmed pentaquark search. 
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Figure 2: The dE/dx values as a function of momentum, P, for particles which 
yield a mass M{D*p) < 3.6 GeV when combined with (a) D*^ — > {K'n)Tis candi- 
dates and (h) D*^ {K7i7r7T)7is candidates. The lines indicate parameterisations 
for the expectation values of dE/dx for pions, kaons and protons. 
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Figure 3: The distribution of M{D*p) = AAf^""* + M{D*+)pbg for charmed 
pentaquark candidates (dots) obtained with the full data sample using (a) all proton 
candidates, (b) proton candidates with momentum below 1.35 GeV anddE/dx above 
1.3 mips, and (c) proton candidates with momentum above 2 GeV. The extended 
mass difference is defined as AM'^^^ = M^KittTsP) — M^KtitIs) and M(D*+)pdg 
is the nominal D*^ mass. The histograms show the M {D*p) distributions for the 
like-sign combinations. 
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Figure 4: The distribution of M{D*p) = /^M"""^ + M(D*+)pdg for charmed 
pentaquark candidates (dots) obtained in DIS withQ^ > 1 GeV'^ using (a) all proton 
candidates, (b) proton candidates with momentum below 1.35 GeV anddE/dx above 
l.Smips, and (c) proton candidates with momentum above 2 GeV. The extended 
mass difference is defined as AM^"^^ = M^Kinisp) — M^Kinrs) and M(D*+)pdg 
is the nominal D*^ mass. The histograms show the M{D*p) distributions for the 
like-sign combinations. 
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Figure 5: The distribution of M{D*p) = AM"""^ + M(L>*+)pdg for charmed 
pentaquark candidates (dots) (a) in the full data sample and (b) in DIS with > 
1 GeV'^ . The extended mass difference is defined as AAf^^* = M^KixTXTinsp) — 
M{KTnnnis) and M(D*"'")pdg is the nominal D*^ mass. The histograms show the 
M{D*p) distributions for the like-sign combinations. 



21 



> 


45 


CD 


f U 


O 


35 




30 


Q. 




cn 


25 






g 


20 


03 
C 


15 




10 


E 


o 




O 


5 









A n 
4U 




oo 




30 




25 




20 




15 




10 




5 








ZEUS 

n — I — I — ^ — I — I — I — I — ^ — I — I — I — I — ^ — I — I — I — I — ^ — I — I — I — I — ^ — I — I — I — I — p 
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Figure 6: The distribution of M{D*p) = AM^^* + M(L>*+)pdg for charmed 
pentaquark candidates (dots) obtained using HI selection criteria in (a) DIS with 
> 1 GeV'^ and (b) photoproduction with < 1 GeV"^ . The extended mass 
difference is defined as AM^'^* = M^Kmisp) - M{K7ni,) and M(D*+)pdg is the 
nominal D*^ mass. The histograms show a two-component model in which the 
wrong charge {Kti)tIs combinations are used to describe the non-charm contribu- 
tion and the inclusive D*^ Monte Carlo simulation (shaded area) describes the 
contribution of real D*^ mesons. 
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Figure 7: The distribution of M{D*p) for charmed pentaquark candidates (dots) 
selected in (a) the full data sample using D*^ — ^ {Kti)tTs candidates, (b) the full 
data sample using D*^ {K7rnn)7rs candidates, (c) DIS with > 1 GeV^ using 
D*^ {K'k)'Ks candidates and (d) DIS with > 1 GeV'^ using D*^ {Kmm)7is 
candidates. The solid curves are fits to the background function outside the signal 
window 3.07 — 3.13 GeV . The shaded histograms show the Monte Garlo signals, 
normalised to 1% of the number of reconstructed D* mesons, and shown on top of 
the fit interpolations (dashed curves) in the signal window. 
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